Distributed Analysis using ASAP
نویسندگان
چکیده
ASAP is a system for enabling distributed analysis for CMS physicists. It was created with the aim of simplifying the transition from a locally running application to one that is distributed across the Grid. The experience gained in operating the system for the past two years has been used to redevelop a more robust, performant and scalable version. ASAP consists of a client for job creation, control and monitoring and an optional server side component. Once jobs are delegated to the server it will submit, update, fetch or resubmit the job on behalf of the user. ASAP is able to make decisions on the success of the users job and will resubmit if either a grid or application failure is detected. An advanced mode allows running jobs to communicate directly with the server in order to request additional jobs and to set the status of the job directly. These features reduce the turnaround time experienced by the user and increase the likelihood of success.
منابع مشابه
Shortest Paths in Microseconds
Computing shortest paths is a fundamental primitive for several social network applications including sociallysensitive ranking, location-aware search, social auctions and social network privacy. Since these applications compute paths in response to a user query, the goal is to minimize latency while maintaining feasible memory requirements. We present ASAP, a system that achieves this goal by ...
متن کاملASAP: Asynchronous Approximate Data-Parallel Computation
Emerging workloads, such as graph processing and machine learning are approximate because of the scale of data involved and the stochastic nature of the underlying algorithms. These algorithms are often distributed over multiple machines using bulk-synchronous processing (BSP) or other synchronous processing paradigms such as map-reduce. However, data parallel processing primitives such as repe...
متن کاملAutomatic data mapping of signal processing applications
This paper presents a technique to map automatically a complete digital signal processing DSP application onto a parallel machine with distributed memory Unlike other applica tions where coarse or medium grain scheduling techniques can be used DSP applications integrate several thousand of tasks and hence necessitate ne grain considerations More over nding an e ective mapping imperatively requi...
متن کاملUpdating annotations with the distributed annotation system and the automated sequence annotation pipeline
SUMMARY The integration between BioDAS ProServer and Automated Sequence Annotation Pipeline (ASAP) provides an interface for querying diverse annotation sources, chaining and linking results, and standardizing the output using the Distributed Annotation System (DAS) protocol. This interface allows pipeline plans in ASAP to be integrated into any system using HTTP and also allows the information...
متن کاملThe Processing Graph Method Tool (PGMT)
To acquire state-of-the-art hardware at reduced cost, the U.S. Navy is committed to buying Commercial Off The Shelf (COTS) computer hardware. In this rapidly changing technological world, today's hardware will be obsolete tomorrow. The Navy's complex problems often require more computational power than can be delivered by a single serial processor. The solution lies in distributed processing. H...
متن کامل